Actionable data embedded into emails for automating actions of an email client

ABSTRACT

A system in which existing email protocols are leveraged to exchange information between two or more client devices. An email includes an embedded serialized object that comprises instructions to inform one or more behaviors of an email client application performed upon receiving the email or at a later time.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation patent application of U.S. patentapplication Ser. No. 16/865,956, filed May 4, 2020 and titled“Actionable Data Embedded Into Emails for Automating Actions of an EmailClient,” the disclosure of which is hereby incorporated herein byreference in its entirety.

TECHNICAL FIELD

Embodiments described herein relate to electronic mail and, inparticular, to systems and methods for defining and leveraging protocolsfor embedding actionable information as a serialized object into anelectronic mail message and, additionally, to systems and methods forperforming one or more automated actions upon receiving a serializedobject embedded within an electronic mail message received by a mailclient application executing on an end-user electronic device.

BACKGROUND

Electronic mail (“email”) is leveraged for a wide variety of personaland professional purposes. Some emails provoke a recipient to performsome action, such as saving an attachment, replying in a particularmanner, scheduling or performing a non-email task, and so on. In manycases, however, recipients of action-provoking emails frequently receivea number of similar, related, or identical emails which, in turn,provoke the recipient to repetitively perform similar, related, oridentical tasks.

Conventional email client applications often include rules engines thatcan assist email recipients with certain application-levelorganizational tasks (e.g., sorting messages, generating calendar eventsand reminders, and so on), but such applications are often unable toassist users (without substantial manual configuration and testing) withcompleting higher-order repetitive tasks, such as replying to emailswith message-specific content, selecting appropriate recipients of areply, opening an application or web address in response to receiving anemail, and so on.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference will now be made to representative embodiments illustrated inthe accompanying figures. It should be understood that the followingdescriptions are not intended to limit this disclosure to one includedembodiment. To the contrary, the disclosure provided herein is intendedto cover alternatives, modifications, and equivalents as may be includedwithin the spirit and scope of the described embodiments, and as definedby the appended claims.

FIG. 1 depicts a system configured to send and receive emails that mayinclude an actionable serialized object, such as described herein.

FIG. 2 depicts an example client device executing an instance of anemail client application configured to embed an actionable serializedobject into an email, such as described herein.

FIG. 3 depicts the client device and email client application of FIG. 2displaying a graphical user interface configured to solicit user inputleveraged to generate an actionable serialized object to embed into anemail prior to sending.

FIG. 4A depicts another client device executing an instance of an emailclient application having received the email of FIG. 3 and, in response,perform one or more actions defined by the actionable serialized object,such as generating an automated reply email.

FIG. 4B depicts the example client device and email client applicationof FIG. 4A, the email client application displaying a graphical userinterface configured to solicit user input leveraged to generate anactionable serialized object to embed into another email prior tosending.

FIG. 5 depicts yet another client device executing an instance of anemail client application having received the email of FIG. 4B and, inresponse, displaying a graphical user interface defined by theactionable serialized object.

FIG. 6A depicts the example client device and email client applicationof FIG. 4A, the email client application having received the email ofFIG. 5 and, in response, generating an automated reply email with anactionable serialized object defining how the automated replay should bedisplayed.

FIG. 6B depicts the example client device and email client applicationof FIG. 5 , the email client application having received the email ofFIG. 6A and, in response, displaying a notification according to theactionable serialized object.

FIG. 7 is a flowchart depicting example operations of a method ofembedding an actionable serialized object into an email, such asdescribed herein.

FIG. 8 is a flowchart depicting example operations of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein.

FIG. 9 is a flowchart depicting an example operation of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein.

FIG. 10 is a flowchart depicting an example operation of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein.

The use of the same or similar reference numerals in different figuresindicates similar, related, or identical items.

Additionally, it should be understood that the proportions anddimensions (either relative or absolute) of the various features andelements (and collections and groupings thereof) and the boundaries,separations, and positional relationships presented therebetween, areprovided in the accompanying figures merely to facilitate anunderstanding of the various embodiments described herein and,accordingly, may not necessarily be presented or illustrated to scale,and are not intended to indicate any preference or requirement for anillustrated embodiment to the exclusion of embodiments described withreference thereto.

DETAILED DESCRIPTION

Embodiments described herein relate to exchange of information from asender to a recipient via electronic mail messaging, and, in particular,to systems and methods for embedding information and/or actionablecontent into an email message (referred to herein simply as an “email”).

Actionable content embedded into an email by the sender's email clientcan be extracted from that email by the recipient's email client and, inresponse, the recipient's email client can automatically perform one ormore tasks or operations defined by that actionable, embedded content.In this manner, the sender of an email can define how that email isintended to be consumed or otherwise acted upon by the recipient, whichmay substantially improve the recipient's user experience and,additionally, may substantially increase the speed with which thesender's email is acted upon by the recipient. As a result ofarchitectures described herein, both senders and recipients of email canexchange information and can act upon that information in a moreefficient manner. Herein, information embedded in an email (e.g., withina header, within a body, within a subject field, within an addresseefield, and so on) that can be used and/or parsed in order to trigger oneor more automatic actions can be referred to as an “actionableserialized object” or more simply a “serialized object” embedded into anemail. A serialized object as described herein refers to a datastructure, memory object, or other computer-readable data item that hasbeen converted (“serialized”) into a string of bytes suitable to bestored, transmitted, or otherwise communicated between computingresources or shared between instances of software.

A serialized object embedded into an email, as described herein, can beautomatically parsed and/or otherwise consumed at an end-user device(also referred to as a client device) to cause that device to performone or more tasks or operations. This architecture allows for dynamicconfiguration of one or more behaviors of a first user's client device(e.g., a recipient of an email as described herein) according topreferences of a second user (e.g., a sender of an email as describedherein), thereby facilitating richer and more customizeddevice-to-device and/or person-to-person interactions by leveragingestablished and popular email protocols as a communication backbone andwithout requiring pre-configuration of either the first or second user'sclient device.

For example, in one embodiment, a serialized object embedded in an email(e.g., within a header, within a body, within a style sheet, or anyother suitable location) sent from a sender to a recipient may be usedby the sender to define how that message is displayed on the recipient'sdevice. For example, the sender may prefer to hide the email messagefrom the recipients inbox (so as to not clutter the recipients inbox),instead opting to generate a notification. This option may be leveragedby a sender when the sender only has a short message to convey that doesnot warrant (or solicit) a replay, such as “I have arrived.” In suchexamples, the serialized object embedded into the email may include aflag, field, or other data item that indicates the message should onlybe displayed as a notification. In this manner, when the recipient'sdevice receives the message, the serialized object can be extracted andthe flag, field, or other data item can be parsed to inform an action ofthe recipient's device. In this example, the action performed inresponse to parsing the embedded serialized object includes two parts:(1) the message is hidden from the recipient's inbox and (2) anotification is generated including content extracted from the messageand/or from the serialized object itself. In certain continuations ofthis example, the sender may opt to instruct the recipient's device viathe embedded serialized object to play a particular sound, play aparticular video, navigate to a particular URL, load a particularapplication, and so on. A person of skill in the art can readilyappreciate that such examples are not exhaustive; any suitable actioncan be performed by a recipient's device in response to receiving anemail including an embedded serialized object such as described herein.

For example, in other cases, an embedded serialized object may be usedby a recipient's device to generate a graphical user interface. Forexample, a sender may send an email including an embedded serializedobject that causes a recipient's device to display a survey when thatemail is opened. For example, the survey selections or choices may bepredetermined responses to the sender's original email. By selecting asurvey option, the recipient's device may automatically generate a replyemail directed by to the sender including the selection made by therecipient. For example, the sender may send an email to a recipientasking where the two should go to lunch. The sender defines threechoices of Restaurant A, Restaurant B, or Restaurant C. In this example,the recipient's device can extract the serialized object and parseinformation therein to generate a graphical user interface presentingthe three options of Restaurant A, Restaurant B, or Restaurant C. Inthis example, the speed of interaction between the sender and therecipient is substantially increased. More specifically, the recipientneed only make a single selection in order to provide a complete replyto the sender; the recipient is not required to spend time to draft areply email, even a short draft email indicating the recipient's lunchpreference.

In yet another example, an embedded serialized object may triggerseveral actions, some of which may be performed immediately, some ofwhich may be scheduled to be performed at a later time, and some ofwhich may be enqueued to be performed in response to occurrence of somedefined event. Such serialized objects can be leveraged by senders andrecipients of email alike to automate information exchange, follow-ups,and future messaging.

For example, in some cases, an individual (Person A) may wish toleverage email to introduce two personal or professional contacts(Persons B and C). Typically, Person A sends an email to both Person Band Person C. The email may include content describing each person'srelationship to Person A, links to social or professional media, and soon. Thereafter, one or both of Person B or Person C may reply-all tothank Person A and to greet the other part. In certain cases, multipleemails may be generated, nearly all of which may clutter inboxes ofPerson A, Person B, and Person C.

The preceding example interaction can be substantially improved byleveraging actionable email serialized objects such as described herein.In particular, Person A may embed a serialized object that, withoutlimitation: prevents Person A from being copied on any reply to PersonA's message (e.g., Person A may only be added as a blind copy);schedules an automatic follow-up message to Person B and/or Person C intwo weeks (or some other arbitrary time); prior to sending, causesPerson A's device to automatically attach contact cards of Person B andPerson C to the message; and so on. The serialized object may alsogenerate a custom button on devices of Person B and Person C that sendsa pro forma reply email back to Person A, thanking Person A for theintroduction. The embedded serialized object may define that the proforma reply is only shown to Person A as a notification.

In this example, Person A may select contacts for Person B and Person Cand select a button labeled “Introduce.” After selecting this button,Person A's device may automatically (1) generate a pro forma email bodyand subject line (e.g., by populating a template), (2) generate andembed a serialized object into that email that defines any replies backto Person A should show to Person A only as a notification and (3) sendthat email including the serialized object to each of Person B andPerson C. The serialized object may also cause Person A's device toschedule at some future time a follow-up to Person B and Person C ifPerson A does not receive a reply email from either in a given timeperiod. In this example, from Person A's perspective, only a singlebutton press is required to (1) introduce two selected contacts and (2)schedule a follow-up to ensure that the introduction has been received.

When receiving this message from Person A, Person B's device may extractthe embedded serialized object and generate a graphical user interfacebutton labeled “Thank Person A.” Upon selecting this button, Person B'sdevice can automatically generate and send a reply email directed toPerson A only that itself includes a serialized object that causesPerson A's device to (1) show a notification and (2) hide the replyemail from Person A's inbox.

Person B's device may also generate a graphical user interface buttonlabeled “Schedule Meet-up with Person B.” Upon selecting this button,Person B's device can automatically generate and send a reply only toPerson C that itself contains an embedded serialized object includingPerson B's calendar availability for an upcoming time period, along witha listing of Person B's favorite coffee shops or restaurants. WhenPerson C's device receives this message from Person B, it can extractthe serialized object and generate a graphical user interface displayingPerson B's calendar availability (which may be presented alongsidePerson C's availability), and providing one or more selectable elementseach corresponding to a restaurant or coffee shop suggested in PersonB's email. Upon making a selection, Person C's device can automaticallygenerate a reply email back to Person B.

As may be appreciated by a person of skill in the art, in this example,a task of introducing two contacts via email, and receiving andconsuming replies thereto, can be performed in a substantially automatedmanner, triggered only by a single button press initiated by Person A.From Person B's perspective, the task of thanking Person A requires onlya single button interaction, and likewise the task of scheduling ameeting with Person C only requires a single button interaction. FromPerson C's perspective, the task of scheduling a meeting with Person Bonly requires a single selection of a meeting location.

A person of skill in the art may readily appreciate that actionableserialized objects as described herein can be configured and/orleveraged to automate and/or assist with multiple different personal orteam workflows; these preceding examples above are not exhaustive.

More generally and broadly, embodiments described herein can be used toprovide facilitate convenient interactions and data exchange between oneor more persons, leveraging existing email sending and receivingprotocols as a communications backbone. This technique has many benefitsand advantages many of which are described below.

For example, in some embodiments, embedded serialized objects may beleveraged to, without limitation: to facilitate meeting scheduling(e.g., a first person engages a first button on their device toautomatically determine a suitable meeting time, triggering a graphicaluser interface to render at a recipient soliciting a selection by therecipient of a suitable time and/or location); to facilitate filedownloads or file exchange (e.g., a first person engages a first buttonto request a file from a second person, whose email client applicationautomatically locates the file and attaches it to a response email); tofacilitate multi-factor authentication (e.g., an embedded serializedobject includes a cryptographic key used to access a service); and soon. More generally, it may be appreciated that a system as describedherein can be configured to leverage email protocols and embeddedserialized objects to communicably couple two or more end-userelectronic devices. More specifically, end-user electronic devicesexecuting instances of email client applications can perform functions,exchange information, launch applications, obtain sensor readings,initiate communication sessions (e.g., SIP), establish datacommunication channels (e.g., tunnels, secure shells, and so on),exchange cryptographic keys, and so on.

In further examples, embedded serialized objects as described herein cancommunicably couple multiple devices together. For example, an embeddedserialized object send to a group of recipient addresses can instructeach device to launch a video conferencing software. In this example, asender of a single email can automatically initiate a video conferencewith multiple participants without requiring those participants tomanually launch specific software, enter meeting information orcredentials, and so on. Such use cases may be of particular benefit topersons that are unfamiliar with particular technologies or how toleverage them. For example, an embedded serialized object sent to anemail client of person with disability or a novice technology user cangreatly improve that person's interaction experience with technologyand, additionally, with the sender of the email.

In yet further examples, embedded serialized objects as described hereincan communicably couple end-user devices together. For example, anembedded serialized object can include a cryptographic key such as anSSH key that causes an end-user device to reverse tunnel to the sender'send-user device. Such constructions can be leveraged by informationtechnology support staff when debugging end-user issues.

In yet further examples, embedded serialized objects as described hereincan be leveraged as a proxy. For example, an embedded serialized objectcan instruct a recipient device to access a web page, API, or service,and to return results of that access to the sender of the email.

In yet other examples, embedded serialized objects as described hereincan be leveraged for parental or other administrative control purposes.For example, an embedded serialized object may instruct a recipientend-user device to generate a use report including information such ascurrent network connections, application use, sensor outputs and so on.This information can be returned to the sender of the email.

More generally and broadly, as described herein, an end-user electronicdevice (also referred to herein as a “client device”) can execute aemail client application, configured as described herein, that extractsthe embedded information and/or instructions (referred to herein as a“serialized object”) and can cause the client device to perform one ormore system-level and/or application-level functions (in sequence or inparallel, substantially simultaneously), automatically, and according toone or more instructions or data items defined in the serialized object.

As a result of these constructions, a sender of an email can informand/or otherwise dictate (1) how that email is consumed by a targetend-user, (2) how that email is consumed and/or processed by anend-user's electronic device, and/or (3) what function or functions arecipient electronic device can or should perform in response toreceiving a message from that sender.

Example ways by which the manner an end-user consumes an email receivedby an email client application, such as described herein, can include,but are not limited to: suppressing display of an email from an emaillist (also referred to as an “inbox”); displaying an email in adifferent manner than other emails; displaying content of an email in adifferent user interface location, separate from the user's inbox (e.g.,a tab or location dedicated to different message types, such as socialmedia messages, software service notifications, shopping messages, andthe like); and the like.

Example functions that can be performed by an email client applicationin response to receiving an email including a serialized object such asdescribed herein include, but are not limited to: suppressing display ofan email from an inbox and, instead, generating a native applicationnotification formatted according to a serialized object extracted fromthe mail message; suppressing display of an email from an inbox and,instead, generating a native application notification with contentdefined by, or extracted from, a serialized object extracted from themail message; displaying a received email according to, or otherwiseinformed by, a format definition extracted from a serialized objectextracted from the email; displaying an already-received email or a setof already-received emails, according to, or otherwise informed by, aformat definition extracted from a serialized object extracted from anewly-received email; and the like. Such tasks may be performedimmediately and/or may be scheduled to be performed at a future timeand/or may be enqueued to be performed in response to a particularevent, such as receiving a particularly-formatted email or serializedobject such as described herein.

Example functions that can be performed by an end-user client device,such as described herein, in response to an email client applicationexecuted by that end user client device receiving an email including aserialized object such as described herein include, but are not limitedto: accessing a sensor (e.g., a gyroscope, an accelerometer, a globalpositioning system sensor, a battery level sensor, a camera or imagesensor, a light sensor, an acoustic sensor, or an environmental sensorsuch as a temperature sensor, humidity sensor, hygrometer, barometer,air quality sensor, and so on) of the client device and obtaining astate or status of the sensor; performing an action with a haptic outputelement of the client device; performing a disk-level action (e.g., adda file, delete a file, move a file, and so on) outside of the context orsandbox of the email client application; and so on.

In further examples, multiple functions can be performed by the end-userclient device in a workflow, program, or other order or sequence toconfer additional benefits to the end-user beyond the convenience ofsimply receiving and consuming an email. For example, an end-user clientdevice can determine its location in response to receiving an email(e.g., via a Bluetooth component, a Wi-Fi component, a global positionsystem sensor, and so on). In these examples, the device's location canbe used to inform or control how one or more actions defined in anembedded serialized object are undertaken. For example, an embeddedserialized object may define that if an email is received when therecipient is at home, the email may be suppressed until a starting timeof the following workday, at which time the recipient's email client maydisplay the message.

In yet another example, an end-user device can be configured to leveragemore than location data. For example, the device may be configured toautomatically connect to a conference room's multimedia system uponreceiving an invitation to a meeting in that conference room when thedevice is physically present within that conference room. In anotherexample, and end-user device can be configured to determine whether theend-user is currently driving a vehicle and/or is using navigationsoftware; for example, to determine whether the user is on his or herway to a meeting. In this example, a meeting cancellation message sentto the user may inform the end-user electronic device to interruptnavigation and to inform the user that the meeting to which the user isdriving has been canceled and/or relocated to a different location. Inthe second case, the end-user device can be configured to automaticallyadjust the destination address based on content of the message received.

In yet other examples, one or more functions of an end-user electronicdevice can be delayed or enqueued until a sensor of the end-userelectronic device transitions to a particular desired state. Forexample, an email related to a task the recipient of that message has toperform in a particular location (e.g., a trouble ticket to fix aparticular piece of office equipment) can be sorted to the top of amessage list when the end user is nearby that particular location. Inone specific example, an information technology specialist may receive anumber of messages on a daily basis each related to or associated withtrouble tickets that require the user's physical presence in differentlocations.

In yet other examples, other sensors or systems of an electronic devicethat receives an email can be used. For example, internet requests forinformation can be initiated in response to receiving an email. As oneexample, if an end-user receives a message that is a receipt for apurchase, a request can be initiated to the credit card issuer such thatthe user's credit card balance may be shown. In another example, anapplication specific to the credit card issuer can be opened to aparticular page (e.g., via deep-linking or another inter-applicationcommunication protocol).

The foregoing examples are not exhaustive; other systems or combinationsof requests can be triggered and/or otherwise leveraged in response toreceiving an email, such as described herein.

For simplicity of description and brevity, the term “email” can be usedherein to refer to an email. An email is typically a file formattedaccording to, and/or otherwise compliant with, one or more protocols andis sent via the open Internet from a sender to a recipient.

More specifically, an email, such as described herein originates atfirst client device that generates and sends that email to a senderserver, also referred to herein as a “third-party server” or “SMTPserver” that communicably couples with an “email host” server associatedwith an email provider, of which the recipient of the email is asubscriber.

At a later time, a second client device operated by the recipient(herein, “end user” or “recipient”) communicably couples to the emailhost and receives a copy of the email sent from the sender, which mayalso include metadata information such as message-identifyinginformation and/or server identifying information. Such information,along with other email metadata included in the email received at theclient device is referred to as “header” information.

More technically, each client device operated by an end-user may includea processor and a memory. The processor can be configured to executeprogram code and/or instructions stored in the memory to instantiate aninstance of an electronic mail client application that, in turn, isconfigured to communicably couple to, and exchange information with, anemail host server and/or an SMTP server. In these examples, theelectronic mail client application can receive and/or otherwise processemail messages stored on the email host server. Once a message isreceived or otherwise obtained by the electronic mail client applicationfrom the email host server, it may be referred to as the “received emailmessage.”

Once the electronic mail client application of the client devicereceives the received email message from the email host server, one ormore processing services, functions, modules, or modes of operation ofthe electronic mail client application can be triggered. One or more ofthese processes can be configured to determine whether the receivedemail message includes embedded information or, in another non-limitingphrasing, whether the received email message includes a serializedobject such as described herein.

In many embodiments, a serialized object such as described herein can beinserted into a body and optionally hidden from view of the receivedemail message and can be tagged or otherwise enclosed within customtags, delimiters, or markup to signal to the electronic mail clientapplication where the string value begins and where the string valueends. For example, in one embodiment, the received email message canhave content formatted according to HTML protocol. In this example, aserialized object such as described herein can be enclosed intags/markup that is compliant with the HTML protocol. For example, theserialized object can be enclosed between “<script>” and “</script>”tags. In other cases, the serialized object can be enclosed betweenentirely custom tags, such as “<custom-serialized object-tag>” and“</custom-serialized object-tag>.” These are merely examples, a personof skill in the art may appreciated that a string serialized object,such as described herein can be suitably identified and/or otherwiseextracted from a body portion of an email in a number of suitable ways.

Additional examples include, but are not limited to: a serialized objectembedded between comment tags; a serialized object embedded in a scriptlink; a serialized object embedded in a Cascading Style Sheet (“CSS”) orlink thereto; a serialized object embedded as an email header; aserialized object embedded as a data item within an existing or customtag; a URL anchored to a remote serialized object or instruction set;and so on. For simplicity of description, the embodiments that followreference a serialized object embedded between custom tags in an (atleast partially) HTML-formatted email message body.

In many examples, a string value corresponding to a serialized objectsuch as described herein conforms to a computer-readable and/orcomputer-parseable format, such as JavaScript Object Notation (“JSON) orExtensible Markup Language (“XML”). In other cases, the serializedobject can be submitted as an attachment to an email message or embeddedin an attachment to an email message. These example formats are notexhaustive, however, and it may be appreciated that in other examplesother computer-readable formats may be considered and/or may beappropriate. For simplicity of description, the embodiments that followreference a JSON-formatted string value that corresponds to a serializedobject, such as described herein.

In view of the foregoing definitions and examples, it may be appreciatedthat a sender of an email message can utilize a graphical user interfaceto select one or more operations corresponding to selections of how thesender desires the serialized object to influence behavior of the email.In particular, the graphical user interface can be generated by oroverlaid atop a graphical user interface of an email client application.Once the sender has completed his or her selections, the sender canindicate to the email client application that the email is ready tosend. In response, the email client application can generate aserialized object corresponding to the sender's request(s), format thatserialized object as a JSON string, enclose that string between customHTML tags, insert the enclosed embedded string into a body of an email,and send the email to an intended recipient or set of recipients.

More specifically, the email client application can communicably coupleto a third-party server to send/route/direct the email to the email hostserver. The email host server can thereafter, optionally, notify theclient device of at least one recipient that a new email message isreceived and is ready for processing.

At a later time (e.g., after receiving a notification from the emailhost server or), the electronic mail client application, executed by therecipient's client device, can receive the email message from the emailhost server and can extract from a document object model (“DOM”) of theHTML-formatted image, a JSON string corresponding to the serializedobject from the received email message. Thereafter, optionally, theelectronic mail client application can parse or otherwise convert thestring value into a data object.

Once the electronic mail client application (of the recipient) hasextracted the serialized object (and, optionally, converted a stringvalue into a data object, or a set of data objects), the electronic mailclient application can execute one or more instructions (also referredto herein as “action items”) defined by the serialized object or,additionally or alternatively, the electronic mail client applicationcan trigger one or more operations or tasks in response to content ofthe serialized object. In this manner, the serialized object defines oneor more behaviors of the electronic mail client application.

For example, in one embodiment, an email can include a serialized objectthat includes an action item that causes the electronic mail clientapplication to hide the email from an end-user's inbox. In this example,the serialized object can include a second action item that causes theelectronic mail client application to generate a notification for theend user that may be shown immediately or at a specified time.

In many cases, content of the notification can be extracted from theserialized object (e.g., defined by the serialized object) or anotherlocation of email body. In some examples, a format, style, or multimediacontent of the notification (e.g., such as an image shown along with thenotification, such as a corporate logo), can be defined by theserialized object.

As a result of the constructions of this example, a sender of the emailcan define a recipient's consumption experience that is substantiallydifferent from a traditional email message. Namely, when the recipientreceives a standard email message, it appears in an inbox of the clientapplication alongside all other messages from other senders. In thisexample, the received email message is hidden from the recipient and,instead, only a notification is shown. In this manner, the recipient'sinbox is uncluttered by the email message, but the recipient stillreceives important information that the sender desires to communicate.

In one specific example, the sender of an email message may be softwareservice, such as a project tracking tool (also referred to as a“collaboration tool”). In these examples, as may be known by a person ofskill in the art, the collaboration tool can be configured to generateemail messages to notify users of the collaboration tool of informationrelated to a project tracked by the tool. In conventional examples, aconventional collaboration tool may generate and send dozens of messagesper day directed to the same recipient.

This quantity of email messages in an user's inbox may reduce theusefulness of the user's email by a substantial amount. Some furtherconventional email clients may be configured to allow for actions to beperformed by a user from the email message itself, however, theseconventional solutions either (1) only perform a single web request thatmay cause a client device to switch applications or for an end user toswitch focus to a new pop-up window or (2) only perform an action thattriggers an email to be sent from the end-user's account. In many cases,a user may not prefer to have unsolicited email sent on the user'sbehalf and/or the user may not prefer to have focus diverted in order totake action upon a task identified in an email message.

As such, continuing the example above, for embodiments described hereina collaboration tool can be configured to embed a serialized object withmultiple action items such as described herein to simplify how theend-user consumes email messages from that collaboration tool. Forexample, the collaboration tool can configure actionable serializedobjects to cause the recipients email client to hide all messages,instead directing data or information from those messages to a dashboardthat summarizes a set of emails received from the collaboration tool, onor more statuses of one or more projects associated with thecollaboration tool, and so on. In these examples, email may be leveragedas a data/notification service that feeds into a graphical userinterface presenting one or more graphics that summarize status ofhigher-order tasks, projects, or other items.

It may be appreciated that the foregoing examples are not exhaustive. Itmay be appreciated that a serialized object, such as described herein,can be configured in any suitable way to trigger or otherwise cause anynumber of suitable tasks or operations to be performed by a clientdevice, such as described herein. The serialized object can cause aclient device to, without limitation: summarize certain email messagesinto a single email message delivered at a particular time of day (e.g.,set by a user's preferences or by a serialized object or both);summarize certain email messages into a single notification that isdisplayed in a customized manner (e.g., with an icon defined by aserialized object, with emphasis or text formatting defined by theserialized object, with a size or shape or style defined by theserialized object and so on) and/or displayed to the user at aparticular interval or at a particular time (e.g., set by a user'spreferences or by a serialized object or both); aggressively notify auser that the email message has been received, by accessing one or moreclient-level notification devices, such as speakers, haptic elements,and/or other service; suppress all indications that a an email messagehas been received; preventing an email received from being stored;emphasizing or performing an action on another email message afterreceiving a first email message (e.g., a reminder message or follow-upmessage); generate a user interface (“UI”) element according to adefinition in the serialized object (e.g., button, slider, popup, textentry field, radio button, select button, and so on); associate anaction to be performed by the client application in response to a userinteraction with a particular UI element; schedule a task to beperformed or an action item to be performed if the user does not performan action within a particular time period; retrieve input from a sensoror other hardware component of the end-user device and send informationretrieved therefrom to another component or system; and so on.

In further examples, a collaboration tool may send email messages to auser: each time a project assigned to the end user is updated; each timeanother user comments on something owned, authored, or under the controlof the end user; at an interval with statistics describing the functionor operation of a project in a given time period (e.g., how many usersaccessed a site or page on a particular day, how many unit tests arepassing or failing, how many team members pushed commits to a particularproject in a particular time period, and so on); and the like. In theseexamples, the collaboration tool can be configured to inject or embed aserialized object that triggers different behavior on the end user'sdevice depending upon the type or kind of message sent by thenotification service. For example, informational notices sent to the enduser (e.g., statistics, notifications, and so on) may be presented in adifferent manner than actionable notices (e.g., surveys, approvalemails, meeting invitations, voting, and so on). For example,information notices that are high priority may be suppressed from theuser's inbox but may trigger the electronic mail client application togenerate a high priority notification (e.g., along with a sound, ahaptic alert, and so on). In these cases, informational notices that arelow priority may be suppressed from the user's inbox but may trigger theelectronic mail client application to generate a summary notification oremail message once per day (or at another interval such as weekly,hourly, and so on) that summarizes content from all messages of thattype received in a time interval. Similarly, informational notices thathave a medium priority may be suppressed from the user's inbox but maytrigger the electronic mail client application to generate alow-priority notification (e.g., lock screen notification, silentnotification, and the like) that the email.

In other examples, a collaboration tool can create a serialized objectthat triggers actions based, at least in part, on the end-user'slocation when that user receives an email message. In a simple phrasing,in some examples, the collaboration tool can instruct the client'sdevice to locate itself (e.g., by leveraging a global positioningsensor, by accessing Wi-Fi connection information, and so on) and, basedon the location, determine whether additional action items should beperformed. In a simple example, this construction can enable differentbehaviors for notifications or other action items based on whether theuser is at work, whether the user is at a job site, or whether the useris not within a recognized area. In this manner, a user's work-relatednotifications or emails may be processed differently depending uponwhere the user is when the message is received. In another example, theserialized object can further cause the user's electronic mail clientapplication to generate an out of office message in response toreceiving a message when the user's client device determines that theuser is not within a recognized location.

Similar to location information obtained from a user's client device,other outputs from other sensors can be obtained to inform otherbehaviors of the electronic mail client application and/or the clientdevice. Examples include but are not limited to: providing differentnotification types depending upon ambient sound levels (e.g., highambient sound triggers haptic alerts, whereas low ambient sound triggersaudio alerts); providing different user interface elements or differentuser interfaces based on whether the user is driving (e.g., a globalpositioning sensor reports high speed); providing different userinterface elements, different alerts, or different notification schemesbased on a time of day or night; increasing or decreasing a reminderpriority based on the user's location (e.g., suppress a reminder for auser to visit a file room if a Bluetooth module of the user's devicereports that the user is within the file room); and so on.

As noted above, the foregoing examples are not exhaustive. To thecontrary it will be appreciated that a serialized object such asdescribed herein can be configured to define or leverage aTuring-complete programming language to trigger or cause to be triggeredany suitable action or execution of code by a user's client device or bya user's electronic mail client application. In this manner, theembodiments described herein reference a defined format or protocol thatcan be leveraged by a sender of an email message and a recipient of anemail message to convey additional information and/or to performadditional actions. In this manner, in a more simple and non-limitingphrasing, the embodiments described herein leverage popular and existingemail communications protocols to confer additional functionality to auser that may provide the user with a more pleasant, a more organized,and a more useful email consumption experience. More broadly,embodiments described herein can leverage popular and existing emailcommunication protocols to facilitate general communication betweenmultiple end-user devices, whether such devices are owned and operatedby the same person or different persons. Communications can include, butmay not be limited to shell access, API access, sensor/hardware access,application access, and so on.

These foregoing and other embodiments are discussed below with referenceto FIGS. 1-10 . However, those skilled in the art will readilyappreciate that the detailed description given herein with respect tothese figures is for explanation only and should not be construed aslimiting.

FIG. 1 depicts a system configured to transmit email messages to arecipient. An email sent via the system 100 can include an embeddedserialized object such as described herein. In the illustrated exampleembodiment, the system 100 includes an email host server 102 which, inturn, is communicably coupled to both a client device 104 and athird-party server 106, also referred to herein as a sender server. Thethird-party server 106 can be further communicably coupled to anotherclient device (not shown) from which the third-party server 106 canreceive an email message such as described herein. In this architecture,the other client device (not shown) can be operated by a sender of theemail message and the client device 104 can be operated by a recipientof that email. The third-party service 106, in this manner, is an emailprovider of the sender and the email host 102 is an email provider ofthe recipient.

More specifically, in many embodiments, the email host server 102 iscommunicably coupled to the third-party server 106 via one or more emailmessage sending communication protocols, such as the Simple MailTransfer Protocol (“SMTP”). Likewise, the sender's client device can becoupled to the third-party server 106 via SMTP. The email host server102 is also communicably coupled to the client device 104, therecipient's client device, via one or more email message receiptcommunication protocols, such as the Internet Message Access Protocol(“IMAP”), the Post Office Protocol (e.g., “POP3”), or other protocols,such as Microsoft's Exchange/ActiveSync protocol.

As a result of this architecture, the third-party server 106 cangenerate and/or receive an email 108 that includes a serialized object110, such as described herein, and can communicate the email 108 to theemail host server 102 which may store the email 108 in a database, suchas one of the databases 102 a. In many examples, the email 108 isencrypted prior to being stored in the database, but this may not berequired of all embodiments.

At a later time, the client device 104 (the recipient's client device)can submit a request to the email host server 102 to retrieve a copy ofthe email 108, served from one of the databases of the email host server102. Thereafter, the client device 104 or more particularly a clientapplication instance executed by the client device 104 can parse theemail to extract an embedded serialized object, such as the serializedobject 110, such as described herein. The serialized object 110 and/orits contents can be consumed by the client application of the clientdevice 104 to perform and/or schedule one or more actions, such asdescribed above or elsewhere herein. In some cases, the serializedobject 110 can cause the client device 104 to perform a task involvingthe third-party server 106, the email host 102, or a remote database,such as the remote database 112. For example, the serialized object 110can cause the client device 104, in some embodiments, to send anotheremail message leveraging the third-party server 106 as an SMTP server.In other cases, the serialized object 110 can cause the client device104 to send a reply email via the email host 102 (e.g., the email host102 acts as an SMTP server). In yet other examples, the serializedobject 110 can cause the client device 104 to submit a query to a remotedatabase, such as the remote database 112. As one example, the remotedatabase 112 may be a database associated with a collaboration tool,such as described above, storing as one example status of one or moreprojects tracked by a project management service of the collaborationtool. In this example, the serialized object 110 can cause the clientdevice 104 to query the project management server for a status update ona particular project tracked by that tool. Thereafter, the results ofthe query can be displayed via a graphical user interface of the clientdevice 104. In this architecture, the email 108 triggers an automaticworkflow that informs the recipient of that email a current status of aproject of interest to that recipient.

It is appreciated that the foregoing embodiment depicted in FIG. 1 andthe various alternatives thereof and variations thereto are presented,generally, for purposes of explanation, and to facilitate anunderstanding of various configurations and constructions of a system,such as described herein. However, it will be apparent to one skilled inthe art that some of the specific details presented herein may not berequired in order to practice a particular described embodiment, or anequivalent thereof.

For example, each server or service of the system 100 of FIG. 1 can beimplemented in a number of suitable ways. As illustrated, the email hostserver 102, the third-party server 106, and the client device 104 eachincludes one or more purpose-configured components, which may be eithersoftware or hardware.

In particular, it may be appreciated that although these functionalelements are identified as separate and distinct devices (e.g., servers)that can each include allocations of physical or virtual resources(identified in the figure as the resource allocations 102 b, 104 a, and106 a respectively), such as one or more processors, memory, and/orcommunication modules (e.g., network connections and the like), thatsuch an implementation is not required. More generally, it may beappreciated that the various functions described herein of a host server102 can be performed by any suitable physical hardware, virtual machine,containerized machine, or any combination thereof.

The foregoing embodiment depicted in FIG. 1 and the various alternativesthereof and variations thereto are presented, generally, for purposes ofexplanation, and to facilitate an understanding of variousconfigurations and constructions of a system, such as described herein.However, it will be apparent to one skilled in the art that some of thespecific details presented herein may not be required in order topractice a particular described embodiment, or an equivalent thereof.

For example, as noted above, it may be appreciated that a serializedobject embedded in an email can be leveraged for a number of purposes,some of which may invoke or provoke action by a recipient of email, someof which may be performed completely automatically and in thebackground.

Generally and broadly, FIGS. 2-6B are presented herein to illustrateseveral discrete example embodiments of systems described herein. Inparticular, each figure illustrates a client device that may beconfigured to render a graphical user interface defined, at least inpart, by an instance of an email client application configured togenerate and/or parse embedded serialized objects as described herein.

Although each of these figures illustrates an example client device as adesktop computer, it may be appreciated that this is merely one example.In other configurations and/or architectures, other electronic devicescan be used including mobile devices, tablet devices, and wearabledevices.

In addition, these figures follow an example use case involving threeparties, each leveraging a respective one instance of an email clientapplication on a respective one client device.

More specifically, FIGS. 2-6B follows an example interaction in which afirst user leverages systems and methods described herein which, inturn, operate over existing an popular email communication protocols, tofacilitate an introduction between a second user and a third user. Asnoted above, this example contemplates that the first user leverages afirst client device executing a first instance of an email clientapplication, the second user leverages a second client device executinga second instance of an email client application, and the third userleverages a third client device executing a third instance of an emailclient application. In some embodiments, each of the client devices maybe the same type or class of electronic device (e.g., laptop computers),but this is not required. In other examples, each individual user mayleverage a different class of electronic device. Similarly, in someembodiments each email client application may be a separate instance ofthe same client application, but this is not required. In otherexamples, different client applications (e.g., supported and/ordeveloped by different entities) may be used.

Absent the advantages of systems described herein, the exampleinteraction between the first user, second user, and third user in whichthe first user introduces the second user to the third user is asubstantially manual process. Human error, tone misinterpretation, andresponse latency may prevent or delay the introduction intended by thefirst user between the second and third users. For example, byleveraging email in a conventional manner, the first user may reach outto both the second user and the third user to mutually introduce thetwo. In some circumstances, the second user and/or the third user maynot readily notice the email from the first user and may have a delayedresponse; this may be interpreted by one or more users as rude orunprofessional behavior. In other examples, one or both of the seconduser or the third user may reply all to the introduction message,thereafter copying the first user to unnecessary planning emailsexchanged between the second user and the third user. In still otherexamples, the first user may forget to follow up on his or her originalmessage.

Embodiments described herein can be leveraged to substantially automateand/or normalize the communications between the first user, the seconduser, and the third user to facilitate a quick and efficient interactionbetween all three users. In particular, as noted above, the exampleinteraction described in reference to FIGS. 2-6B follows the mutualintroduction between the second user and the third user, initiated bythe first user.

More specifically, the first user initially uses a graphical userinterface (e.g., by selecting a button thereof, by accessing a menu itemthereof, and so on) of the first client application to indicate that thefirst user intends to send an email with an embedded serialized objectthat facilitates an introduction between two persons. In response, thefirst client application generates a graphical user interface which thefirst user can use to select two or more persons to introduce. The firstuser can leverage this graphical user interface to select the seconduser and the third user. As one example, the graphical user interfacemay communicably couple (via a suitable API) to a contact directory,social media service, or professional media service. Thereafter thefirst user can select a graphical user interface button or otherselectable item indicating that the first user has completed his or herselections and desires to proceed with mutually introducing all selectedpersons.

In many embodiments, the first client application can be furtherconfigured to generate a body and/or a subject of the email into whichthe serialized object is embedded. For example, the first clientapplication can be configured to select from a set of introduction emailtemplates a single email template. The selected email template may beselected and/or edited by the first user via the graphical userinterface, although this is not required.

In response to these above-described selections, the first client deviceor, more particularly, the first client application can generate aserialized object and embed that serialized object into the body of anemail to be sent to the second user and the third user. As noted above,the email may be drafted in whole or in part by the first user, whereasin other cases, the email is selected from a template. Once the emailbody/subject is selected, a serialized object such as described hereincan be embedded therein.

The serialized object can be configured to provoke a number of selectedbehaviors at the second and third client applications. For example, insome embodiments, the serialized object can be configured to prevent thefirst user from being added to a reply-all message. More specifically,the serialized object can limit the second or third client applicationssuch that if either the second or third user attempt to reply all to theemail message, the first user's email address will be omitted or, insome cases, added only to a BCC address field.

In other cases, the serialized object can be configured to cause thesecond and third client applications to communicably couple and to sharegeographic location information, calendar information, contactinformation, or any other suitable information. Such information sharingbetween the second user and the third user can help facilitate a quickand efficient introduction between them.

In yet other examples, the serialized object can be configured to causethe second and/or third client applications to generate or customize agraphical user interface providing supplemental options or features tothe second or third users. For example, in one embodiment, theserialized object can define that a “thank you” button should berendered in the second or third client applications. After clicking the“thank you” button, an email message can be automatically generated andsent to the first user, as a reply. The reply email can be selected froma set of template emails including content thanking the first user forfacilitating the introduction. In some examples, the reply emailgenerated in response to engaging the “thank you” button can itselfinclude an embedded serialized object that causes the first clientapplication to show only a notification to the first user.

These preceding examples are not exhaustive of the behaviors that may beprovoked or leveraged by a system as described herein. As such, and tofacilitate a thorough understanding of one example interaction use casein which various user may share data, and/or more efficiently interact,by leveraging embedded serialized objects, FIGS. 2-6B are providedbelow.

FIG. 2 depicts an example client device executing an instance of anemail client application configured to embed an actionable serializedobject into an email, such as described herein. In particular, a firstclient device 200 includes a housing 202 that encloses and supports adisplay 204. The display 204 can be leveraged by an instance of a anemail client application to generate a graphical user interface 206.

As noted above, the email client application (or, more simply, a clientapplication) can be defined by executable code or instructions stored ina persistent memory of the first client device 200. A processor of thefirst client device 200 can be communicably coupled to the persistentmemory and can access the persistent memory to load at least a portionof the executable code or instructions into a working memory in order toinstantiate the client application. For simplicity of description, aninstantiated client application is referred to herein, simply as aclient application. For simplicity of illustration, the first clientdevice 200 is depicted without a processor, a working memory, or apersistent memory; it may be appreciated however that such components(also referred to as resource allocations with reference to FIG. 1 ) maybe included within the housing or in another location.

The graphical user interface 206 rendered by the client application isconfigured to present information related to emails received by a userof the first client device 200. For example, the graphical userinterface 206 can present a message list 208 and/or one or moreactionable buttons 210. The message list 208, also referred to as aninbox, can display condensed information about messages recentlyreceived by the client application. The actionable buttons 210 can beleveraged by the user to instruct the client application to perform oneor more tasks, some of which may include generating and/or embedding aserialized object into an email draft. For example, as shown theactionable buttons 210 include a reply button 212. The reply button 212may be selected by a user in order to reply to a sender of a messagereceived by the client application.

The actionable buttons 210 can also include an introduction button 214,which may be selected by a user in order to generate a message, such asdescribed above, that includes an embedded serialized object configuredto facilitate a mutual introduction between two or more selectedrecipients of the message. Examples of actions that may be performed,triggered, scheduled, delegated, or provoked by an embedded serializedobject associated with the introduction button 214 include but are notlimited to: limiting to whom the email message may be forwarded;defining an encryption protocol or public key for use when reading orresponding to the message; defining a particular SMTP server that shouldbe used when responding to the message; setting a reply-to field of themessage or any reply message; requiring at least one contact cardattachment before a reply to the message can be sent; enforcingspellcheck before the message can be sent; accessing or sharing acalendar availability; and so on. It may be appreciated that theseexamples are not exhaustive; an introduction button as described hereincan be associated with and/or can cause the embedding of a number ofserialized objects.

The actionable buttons 210 can also include an ask button 216, which maybe selected by a user in order to generate a message, such as describedherein, that includes an embedded serialized object configured to causea recipient electronic device/client application to render a graphicaluser interface with a limited set of selectable options. This button maybe used to solicit a quick answer to a question, thereby improving thespeed with which an email reply can be generated. For example, when auser presses the ask button 216, the client application may beconfigured to generate a user interface through which the user can addone or more predetermined responses to a question that the user desiresto ask of the intended recipient of the email. For example, if the userintends to direct an email to a recipient asking whether to rescheduleor cancel a meeting, the user can leverage the graphical user interfaceof the client device to add two predetermine responses. A first responsereads “Cancel the meeting” and a second response reads “Reschedule for alater time.” Each of the first response and the second response can beadded to a serialized object that can be embedded into an email sent tothe recipient. Upon receiving the message, with the embedded serializedobject, the recipient's client application can render a graphical userinterface including only two selectable items—a first item reading“Cancel the meeting” and a second item reading “Reschedule the meeting.”By selecting one of these two options, the recipient can quickly respondto the sender's original message. In this manner, the sender of themessage (e.g., a user of the client device 200) can quickly solicit aresponse from a colleague, supervisor, client, vendor, or any othersuitable person. These example embodiments can dramatically increase thespeed with which information is exchanged between individuals via email.

The actionable buttons 210 can also include a notify button 218, whichmay be selected by a user in order to generate a message, such asdescribed above, that includes an embedded serialized object configuredto generate a notification, instead of displaying a message within themessage list 208.

In the illustrated embodiment, the introduction button 214 is selectedby a user, indicating a user intent to introduce at last two contacts toone another. FIG. 3 depicts the client device and email clientapplication of FIG. 2 displaying a graphical user interface configuredto solicit user input leveraged to generate an actionable serializedobject to embed into an email prior to sending. In particular, the firstclient device 200 (including, as noted above, a housing 202, a display204 and a graphical user interface 206 rendered by a clientapplication), after having received input from the user selecting theintroduction button 214 (shown in FIG. 2 ), can display an overlaygraphical user interface, shown in the figure as the graphical userinterface 300.

The graphical user interface 300 can be specifically tailored to displayoptions, parameters, and selections available to the user whenfacilitating an introduction. For example, as shown the graphical userinterface 300 can include a contact selection region 302 that can beleveraged by the user in order to select or add contacts for mutualintroduction. In addition, the graphical user interface can include adescription area 304 that can be used by the user in order to addadditional context, such as a description of how the user is connectedwith each of the selected contacts identified in the contact selectregion 302. Once information has been added to the user's satisfaction,the user can press a send button 306 that, in turn, will send an email308 with an embedded serialized object (not shown), such as describedherein. The email 308 may be selected from a set of templates, and mayinclude fields that can be populated with information derived from orotherwise extracted from the user's inputs to the graphical userinterface 300, such as email addresses of the selected contacts, namesof the selected contacts, the first name and/or signature of thesender/user, background information describing a relationship betweenthe user and one or more of the contacts, and so on. It may beappreciated that the foregoing example user interface elements are notexhaustive of the various types of elements that may be included in thegraphical user interface 300—in other embodiments, additional (or fewer)user interface elements may be shown.

As noted above, the client application may of the first client device200 can generate a serialized object to define one or more actions thatcan be performed by a recipient's (e.g., each of the contacts selectedby the user from the graphical user interface 300) client application.For example, FIG. 4A depicts another client device, a second clientdevice 400, executing an instance of an email client application havingreceived the email 308 shown in FIG. 3 and, in response, performing oneor more actions defined by the actionable serialized object, such asgenerating an automated reply email and/or generating a graphical userinterface element.

In particular, much like the first client device 200, the second clientdevice 400 can include a housing 402 enclosing and supporting a display404 that, in turn, can be leveraged by a processor, memory, and aninstance of a client application to render a graphical user interface406. The graphical user interface 406, as with the embodiment depictedin FIGS. 2-3 can include a message list, identified as the message list408. In the illustrated embodiment, the email 308 sent by the firstclient device 200 is shown as the email 410.

The email 410 includes an actionable serialized object, which as notedabove may be embedded into an HTML body of the email 410. In thisexample, the actionable serialized object sent from the clientapplication of the first client device 200 (see, e.g., FIGS. 2-3 ) cancause the client application of the second client device 400 to rendertwo additional, custom, user interface elements. In particular, as showntwo additional user interface elements are shown atop the email 410within the message list 408. It may a be appreciated, however, that thisis merely one example implementation and that in other examples, anothergraphical user interface element or modification can be made.

In this example, two buttons are shown overlaid the email 410. Inparticular, a first button 414 is shown as a save button 412 which, whenselected by a user of the second client device 400, can save the email410 and/or an attachment thereof (such as a contact card of anothercopied recipient of the email 410) to a predetermined or selectablelocation.

The graphical user interface 406 is also modified by the actionableserialized object embedded in the email 410 to generate a thank button414. The thank button 414 can be used by a user to automaticallygenerate an email 416, which may be defined and/or selected at least inpart by the actionable serialized object embedded within the email 410.The email 416 can be populated with content extracted from or identifiedby the actionable serialized object embedded in the email 410. Inaddition, the email 416 can populate CC and BCC fields based, at leastin part, on instructions provided by the actionable serialized objectembedded in the email 410. For example, as shown, the email 416 is not areply message to the email 410, but rather the client application of thesecond client device 400 automatically adds the sender (the user of thefirst client device 200) of the email 410 to a BCC field, leaving onlyother recipients of the email 410 in the CC field. This action of movingthe sender to the BCC field can be defined by the actionable serializedobject as generated by the client application of the first client device200, as shown in FIGS. 2-3 . In this manner, more generally and broadly,serialized objects sent between different end-users can be chained,linked, derived from one another, or may build upon one another toarchitect a request-response system in which a first client device sendsa request (e.g., an email with a first serialized object) to a secondclient device which returns a response (e.g., a reply with a secondserialized object). In other cases, the first or second devices maygenerate response to a third electronic device via email or anothercommunication channel.

In other examples, the user of the second client device 400 mayadditionally or alternatively desire to directly coordinate with otherrecipients of the introduction email, the email 410, sent by the user ofthe first client device. For example, the user of the second clientdevice 400 may prefer to leverage the ask button, such as the ask button216 (shown in FIG. 2 ) to directly solicit feedback from otherrecipients of the mutual introduction email, the email 410. For example,FIG. 4B depicts the example client device and email client applicationof FIG. 4A, the email client application displaying a graphical userinterface configured to solicit user input leveraged to generate anactionable serialized object to embed into another email prior tosending.

More specifically, the second client device 400, executing the clientapplication discussed above with reference to FIG. 4 , can generate anoverlaid graphical user interface labeled in the figure as the graphicaluser interface 418. The graphical user interface 418 can be configuredto solicit and receive input from the user of the second client device400, such as options for meeting with another recipient of the email410. More particularly, the graphical user interface 418 can include asurvey data entry area 420 that can be leveraged by the user of thesecond client device 400 to add multiple options. As the user addsanother option, the user may press an add button 422 to signal that theuser's input with respect to the most recently entered option iscomplete. Once the user has added all relevant or desired options, theuser may press a send button 424 to generate an email 416 directed toother recipients of the original message, the email 410. In manyembodiments survey items can also be associated with particular formatsor display preferences. For example, a “positive response” to a surveyquestion may be highlighted or shown in a green color, whereas a“negative response” may be shown in a red color. In other cases, asurvey may request information related to approving expenses; high valueapprovals may be shown alongside several sequential currency icons orglyphs and low value approvals may be shown alongside fewer sequentialcurrency icons or glyphs. In this example, different shades of green, ora graduated scale from green to red, may be used to visually emphasizedifference between selectable options. More generally, it may beappreciated that formatting options may be encoded into and/or includedwithin an embedded serialized object, such as described herein.

As with other embodiments described herein the message 426 can includean actionable serialized object that informs a recipient clientapplication that the options selected by the user of the second clientdevice 400 should be displayed as a selectable list, and not as astandard email message. For example, FIG. 5 depicts yet another clientdevice, a third client device 500, executing an instance of an emailclient application having received the email 426 of FIG. 4B (and theemail 308 of FIG. 3 ) and, in response, displaying a graphical userinterface defined by the actionable serialized object.

More specifically, the third client device 500, as with otherembodiments described herein, can include a housing 502 enclosing adisplay 504 that, in turn, renders a graphical user interface. Thegraphical user interface 506 can be defined, at least in part by aclient application, such as described above, that is configured toreceive and generate emails. In this example, the third client device,and in particular, the client application instance executing on thethird client device 500 receives and displays in a message list theemail 308 sent from the first client device 200 (see, e.g., FIG. 3 ) andthe email 426 send from the second client device 400. In particular, theemail 426 received from the second client device 400 is identified asthe email 508. As with other embodiments described herein the clientapplication of the third client device 500 can be configured to extractan actionable serialized object from the email 308 sent from the firstclient device and, in response generate two buttons as shown (see alsoFIG. 4A). In addition, the client application of the third client device500 can be configured to extract another actionable serialized objectfrom the email 508 that defines a different graphical user interfacemodification. In particular, the email 508 can include an actionableserialized object that causes the third client device 508—and inparticular the client application instance of the third client device508 to render an answer button 510. The answer button 510, when selectedby a user of the third client device renders a supplemental graphicaluser interface 512 that includes a survey response area 514, presentingoptions for response as defined in the actionable serialized object ofthe email 508. After selecting an appropriate option, the user of thethird client device 500 can operate a button 516 that, according to theactionable serialized object of the email 508, returns a calendar inviteto the sender of the email 508, the user of the second client device(see, e.g., FIG. 4B).

Once the response email to the survey is selected by the user of thethird client device 500, the client application of that device generatesa response email that, in turn, includes an actionable serializedobject. In this case, the actionable serialized object may include anindication that the user of the third client device 500 has selected aparticular option presented by the user of the second client device 400.More particularly, FIG. 6A the second client device 400 having receivedthe response email 600 from the third client device 500 (see, e.g., FIG.5 ). An actionable serialized object can be extracted by the clientapplication of the second client device 400 and can cause thatapplication to display a graphical user interface indicator 602 clearlyshowing which option was selected by the user of the third client deice500. In many cases, the graphical user interface indicator 602 maypresent only a portion of the option selected by the user of the thirdclient device 500, such as “Coffee” in place of “Meet for Coffee.”

After having received the response email 600 from the third clientdevice 500, the user of the second client device may desire to simplynotify the user of the third client device 500 that the user's selectionwas received. This action, as described above, can be performed byleveraging actionable serialized objects as described herein. Inparticular, the user of the second client device 400 can select a notifybutton presented in the graphical user interface 406. The notify buttoncan automatically generate an email, including an actionable serializedobject defining that the message should be shown only as a notification,and send that email to the user of the third client device 500. FIG. 6Bdepicts the third client device 500, hiding the message from a messagelist of the graphical user interface 506, and instead presenting only anotification 604.

These foregoing embodiments depicted in FIGS. 2-6B and the variousalternatives thereof and variations thereto are presented, generally,for purposes of explanation, and to facilitate an understanding ofvarious configurations and constructions of a system, such as describedherein. However, it will be apparent to one skilled in the art that someof the specific details presented herein may not be required in order topractice a particular described embodiment, or an equivalent thereof.

Thus, it is understood that the foregoing and following descriptions ofspecific embodiments are presented for the limited purposes ofillustration and description. These descriptions are not targeted to beexhaustive or to limit the disclosure to the precise forms recitedherein. To the contrary, it will be apparent to one of ordinary skill inthe art that many modifications and variations are possible in view ofthe above teachings.

FIG. 7 is a flowchart depicting example operations of a method ofembedding an actionable serialized object into an email, such asdescribed herein.

As with other embodiments described herein, the method can be performedin whole or in part by an instance of a client application executing ona client device. In particular, the method can be performed by one ormore hardware resources of that client device, such as a processorand/or a memory. In particular implementations, a processor of theclient device can be configured to access a working and/or persistentmemory to obtain executable instructions or binary files that, whenexecuted by the processor, instantiate at least a portion of the clientapplication. The client application may be an email client application,such as described above, that is configured to receive email and sendemail. In addition, the client application instance may be configured togenerate and/or extract one or more actionable serialized objects fromemail messages.

The instance can be configured to extract an actionable serializedobject using any suitable method or combination of methods. In manyembodiments, a serialized object is enclosed between custom tags withina document object model of an HTML-formatted email message body. Inother examples. For example, the actionable serialized object may be aJSON object and/or Javascript function.

In many cases, the instance may be configured to execute a portion ofthe serialized object with an interpreter or compiler separate from theinstance itself. In other cases, the serialized object(s) can includeobject data and/or data fields that can be extracted and/or typecast asparticular variables or variable types.

Actionable serialized objects can be of any suitable object depth ortree structure; a flat object with a single attribute or single set ofattributes distributed or arranged in key-value pairs is neitherpreferred nor implied.

In further embodiments, the instance can be configured to instruct athird party application or third party server, whether local or remote,to perform at least a portion of a task defined by an actionableserialized object.

In particular, the method 700 includes operation 702 at which input isreceived from a user to generate an actionable email, or as referred toherein, an email including an embedded/actionable serialized object. Themethod advances to operation 704 at which a graphical user interface ispresented to that user that solicits input from the user to select oneor more properties of the action(s) to be associated with the actionableemail. Examples include, but are not limited to: recipients of theassociated email; a subject of the associated email; body content of theassociated email; a notification preference; and so on.

The method 700 advances to operation 706 at which the instance, oranother software process or hardware mechanism, generates an embedserialized object (also referred to as an “embedded serialized object”)based on the attributes selected by the user at operation 704. Oncegenerated, the serialized object can be embedded into a header or otherportion of a draft email.

Finally, the method 700 optionally advances to 708 at which one or moretasks can be scheduled based, at least in part, on the input receivedfrom the user. Example tasks include, but are not limited to: schedulinga follow-up message; adding a calendar event; adding a task; providinginput to one or more collaboration tools, such as a project trackingapplication; accessing third party data to generate a follow-up email orreminder; and so on.

FIG. 8 is a flowchart depicting example operations of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein. Themethod can be performed by any suitable hardware or softwarecombination, such as described above with reference to FIG. 7 ; thisdescription and its various alternative constructions are not repeated.

The method 800 includes operation 802 at which an email is received at aclient application. Thereafter, advancing to operation 804, the clientapplication can extract an actionable serialized object, also referredto as an “embed serialized object.” The client application can beconfigured to extract eh serialized object from any suitable portion ofthe email, including the email body, the email subject line, the emailheaders, and so on. In some examples, portions of a serialized objectmay be found in different portions of an email; in other cases multipleserialized objects can be embedded. After extracting a serializedobject, the method 800 can advance to determine one or more actiontypes, and/or one or more action attributes as defined in the actionableserialized object.

The method 800 thereafter advances to operation 806 at which one or moreactions can be performed based on the information extracted and/ordetermined at operation 804. Finally, the method 800 optionally advancesto 808 at which one or more tasks can be scheduled based, at least inpart, on the input received from the user. Example tasks include, butare not limited to: scheduling a follow-up message; adding a calendarevent; adding a task; providing input to one or more collaborationtools, such as a project tracking application; accessing third partydata to generate a follow-up email or reminder; and so on.

FIG. 9 is a flowchart depicting an example operation of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein. Themethod can be performed by any suitable hardware or softwarecombination, such as described above with reference to FIG. 7 ; thisdescription and its various alternative constructions are not repeated.

The method 900 includes operation 902 at which an email is received atan email client. The email received can include an actionable serializedobject having an action type associated with an introduction email.

The method 900 thereafter advances to operation 904, at which one ormore properties or attributes of the serialized object embedded in themessage received at operation 902 can be examined. For example, in oneembodiment, the method may determine whether the introduction email isintended for a personal or professional purpose. In this example, a keyor data item within the actionable serialized object may identifywhether the introduction email is intended for a professional orpersonal purpose. In other examples, semantic processing, naturallanguage processing, and/or sentiment analysis can be leveraged for thisdetermination.

The method next advances to operation 906 at which the received email isdisplayed in a particular manner (e.g., in a particular location) basedon the introduction email purpose. As a result of this construction,introduction emails are substantially more likely to be acted upon asthe introduction email is unlikely to be lost among a long message listof unrelated messages.

Finally, as described in reference to other methods presented herein,the method 900 optionally advances to 908 at which one or more tasks canbe scheduled based, at least in part, on the input received from theuser. Example tasks include, but are not limited to: scheduling afollow-up message; adding a calendar event; adding a task; providinginput to one or more collaboration tools, such as a project trackingapplication; accessing third party data to generate a follow-up email orreminder; and so on.

FIG. 10 is a flowchart depicting an example operation of a method ofperforming one or more actions in response to receiving an emailincluding an actionable serialized object, such as described herein. Themethod can be performed by any suitable hardware or softwarecombination, such as described above with reference to FIG. 7 ; thisdescription and its various alternative constructions are not repeated.

The method 1000 includes operation 1002 in which a request to reply to amessage including an actionable serialized object is received. Next atoperation 1004, one or more properties of the embedded serialized objectare examined. Next, at operation 1006, the reply message—or moreprecisely a draft email generated to reply to the message—may bemodified based, at least in part, on the embed serialized object. Forexample, the embed serialized object may define that all replies shouldbe directed to BCC and not to a CC line. In another example, the embedserialized object may define that all replies to the sender shouldthemselves include an actionable serialized object to cause the sender'semail client to display the reply message as a notification. Theseexamples are not exhaustive, and other examples are possible.

Finally, as described in reference to other methods presented herein,the method 1000 optionally advances to 1008 at which one or more taskscan be scheduled based, at least in part, on the input received from theuser. Example tasks include, but are not limited to: scheduling afollow-up message; adding a calendar event; adding a task; providinginput to one or more collaboration tools, such as a project trackingapplication; accessing third party data to generate a follow-up email orreminder; and so on.

As used herein, the phrase “at least one of” preceding a series ofitems, with the term “and” or “or” to separate any of the items,modifies the list as a whole, rather than each member of the list. Thephrase “at least one of” does not require selection of at least one ofeach item listed; rather, the phrase allows a meaning that includes at aminimum one of any of the items, and/or at a minimum one of anycombination of the items, and/or at a minimum one of each of the items.By way of example, the phrases “at least one of A, B, and C” or “atleast one of A, B, or C” each refer to only A, only B, or only C; anycombination of A, B, and C; and/or one or more of each of A, B, and C.Similarly, it may be appreciated that an order of elements presented fora conjunctive or disjunctive list provided herein should not beconstrued as limiting the disclosure to only that order provided.

One may appreciate that although many embodiments are disclosed above,that the operations and steps presented with respect to methods andtechniques described herein are meant as exemplary and accordingly arenot exhaustive. One may further appreciate that alternate step order orfewer or additional operations may be required or desired for particularembodiments.

Although the disclosure above is described in terms of various exemplaryembodiments and implementations, it should be understood that thevarious features, aspects and functionality described in one or more ofthe individual embodiments are not limited in their applicability to theparticular embodiment with which they are described, but instead can beapplied, alone or in various combinations, to one or more of the someembodiments of the invention, whether or not such embodiments aredescribed and whether or not such features are presented as being a partof a described embodiment. Thus, the breadth and scope of the presentinvention should not be limited by any of the above-described exemplaryembodiments but is instead defined by the claims herein presented.

In addition, it is understood that organizations and/or entitiesresponsible for the access, aggregation, validation, analysis,disclosure, transfer, storage, or other use of private data such asdescribed herein will preferably comply with published andindustry-established privacy, data, and network security policies andpractices. For example, it is understood that data and/or informationobtained from remote or local data sources, only on informed consent ofthe subject of that data and/or information, should be accessedaggregated only for legitimate, agreed-upon, and reasonable uses.

Example computing resources or appliances that may be configured toreceive email and/or send email as described herein include, but are notlimited to: single or multi-core processors; single or multi-threadprocessors; purpose-configured co-processors (e.g., graphics processingunits, motion processing units, sensor processing units, and the like);volatile or non-volatile memory; application-specific integratedcircuits; field-programmable gate arrays; input/output devices andsystems and components thereof (e.g., keyboards, mice, trackpads,generic human interface devices, video cameras, microphones, speakers,and the like); networking appliances and systems and components thereof(e.g., routers, switches, firewalls, packet shapers, content filters,network interface controllers or cards, access points, modems, and thelike); embedded devices and systems and components thereof (e.g.,system(s)-on-chip, Internet-of-Things devices, and the like); industrialcontrol or automation devices and systems and components thereof (e.g.,programmable logic controllers, programmable relays, supervisory controland data acquisition controllers, discrete controllers, and the like);vehicle or aeronautical control devices systems and components thereof(e.g., navigation devices, safety devices or controllers, securitydevices, and the like); corporate or business infrastructure devices orappliances (e.g., private branch exchange devices, voice-over internetprotocol hosts and controllers, end-user terminals, and the like);personal electronic devices and systems and components thereof (e.g.,cellular phones, tablet computers, desktop computers, laptop computers,wearable devices); personal electronic devices and accessories thereof(e.g., peripheral input devices, wearable devices, implantable devices,medical devices and so on); and so on. It may be appreciated that theforegoing examples are not exhaustive.

The foregoing examples and description of instances ofpurpose-configured software, whether accessible via API as arequest-response service, an event-driven service, or whether configuredas a self-contained data processing service are understood as notexhaustive. In other words, a person of skill in the art may appreciatethat the various functions and operations of a system such as describedherein can be implemented in a number of suitable ways, developedleveraging any number of suitable libraries, frameworks, first orthird-party APIs, local or remote databases (whether relational, NoSQL,or other architectures, or a combination thereof), programminglanguages, software design techniques (e.g., procedural, asynchronous,event-driven, and so on or any combination thereof), and so on. Thevarious functions described herein can be implemented in the same manner(as one example, leveraging a common language and/or design), or indifferent ways. In many embodiments, functions of a system describedherein are implemented as discrete microservices, which may becontainerized or executed/instantiated leveraging a discrete virtualmachine, that are only responsive to authenticated API requests fromother microservices of the same system. Similarly, each microservice maybe configured to provide data output and receive data input across anencrypted data channel. In some cases, each microservice may beconfigured to store its own data in a dedicated encrypted database; inothers, microservices can store encrypted data in a common database;whether such data is stored in tables shared by multiple microservicesor whether microservices may leverage independent and separatetables/schemas can vary from embodiment to embodiment. As a result ofthese described and other equivalent architectures, it may beappreciated that a system such as described herein can be implemented ina number of suitable ways. For simplicity of description, manyembodiments that follow are described in reference an implementation inwhich discrete functions of the system are implemented as discretemicroservices. It is appreciated that this is merely one possibleimplementation.

What is claimed is:
 1. A computer-implemented method of operating anemail client application to suppress display of a received messageaccording to an instruction provided by a sender of the receivedmessage, the method comprising: receiving at the email clientapplication, the received message; extracting from a header, body, orsubject line of the received message a serialized object represented asa string; instantiating, in a memory accessible to the email clientapplication, a data object based on the string; extracting a first fieldfrom the data object, the first field comprising a first instruction tosuppress display of the received message from a main message list;extracting a second field from the data object, the second fieldcomprising a second instruction to display the received message in asecond message list different from the main message list; extracting athird field from the data object, the third field comprising informationto populate into a response template; in response to the firstinstruction, suppressing display of the received message from the mainmessage list; in response to the second instruction, inserting thereceived message into the second message list; selecting a responsetemplate from a set of response templates based on the data object;populating the response template the third field; and automaticallysending the populated response template to at least one of the sender ora recipient identified in the data object.
 2. The computer-implementedmethod of claim 1, wherein the serialized object is extracted from theheader of the received message.
 3. The computer-implemented method ofclaim 1, wherein the serialized object is extracted from the body of thereceived message.
 4. The computer-implemented method of claim 1, whereinthe third field comprises a third instruction to generate a notificationto a user of the email client.
 5. The computer-implemented method ofclaim 4, wherein information displayed by the notification is extractedfrom the data object.
 6. A computer-implemented method comprising:receiving a request from a user of a first client application to createa new email message; generating a data object comprising a field tocause a second client application, executed by a recipient of the newemail message, to: suppress display of the new email message from amessage list of the second client application; and automatically send apopulated template message to at least one of the user or a recipientidentified by the data object; embedding the data object into the newemail message; and sending the new email message in response to aninstruction from the user to send the new email message.
 7. The methodof claim 6, wherein: the field is a first field; and the data objectcomprises a second field to cause the second client application togenerate a native notification in response to the second clientapplication receiving the new email message.
 8. The method of claim 6,wherein: the field is a first field; the message list is a first messagelist; and the data object comprises a second field to cause the secondclient application to display the new email message within a secondmessage list.
 9. The method of claim 8, wherein the data objectcomprises a third field to cause the second client application to rendera user interface element over the new email message when the new emailmessage is displayed in the second message list.
 10. The method of claim9, wherein selection of the user interface element causes the secondclient application to send a reply email to the first clientapplication.
 11. The method of claim 10, wherein the data objectcomprises a fourth field containing a reply phrase; and the reply emailcontains the reply phrase.
 12. The method of claim 6, wherein the dataobject is embedded into a header of the new email message.
 13. Themethod of claim 6, wherein the data object is embedded into a body ofthe new email message.
 14. A computing device configured to communicablycouple to an email server, the computing device comprising: a memorystoring executable instructions; and a processor configured access thememory to execute the executable instructions to instantiate a firstclient application, the first client application configured to: receivean email message originating from a second client application; extractfrom the email message a structured data object; extract from thestructured data object a first field comprising a first instruction tosuppress display of the received email message from a first messagelist; extract from the structured data object a second field comprisinga second instruction to display the received email message in a secondmessage list; extract from the structured data object a third fieldcomprising a third instruction to automatically select, populate, andsend a reply email template; in response to the first instruction,suppress display of the received email message from the first messagelist; in response to the second instruction, display the received emailmessage in the second message list; and in response to the thirdinstruction, select a template from a set of templates, populate thetemplate with information obtained from the structured data object, andsend the populated template to a recipient identified by the structureddata object.
 15. The computing device of claim 14, wherein the firstclient application is further configured to extract from the structureddata object a third field comprising a third instruction to render agraphical user interface element over the received email message in thesecond message list.
 16. The computing device of claim 15, wherein thegraphical user interface element comprises a button.
 17. The computingdevice of claim 16, wherein selection of the button causes the firstclient application to automatically send a reply email to a sender ofthe received email message.
 18. The computing device of claim 16,wherein selection of the button causes the first client application toautomatically send a reply email to a recipient defined at least in partin or by the received email message.
 19. The computing device of claim15, wherein the graphical user interface element comprises a set ofbuttons, functions of which are defined at least in part by thestructured data object.
 20. The computing device of claim 19, whereinthe email server comprises an SMTP server.